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1  Original  Proposal  Summary 

This  research  focuses  on  developing  a  broad  theoretical  modeling  framework  for  robotic  networks  with  a 
rich  application  catalog  of  combinatorial  and  geometric  tasks.  For  a  detailed  realistic  model  combining 
mobile  robotics  and  ad  hoc  wireless  networking,  we  envision  designing  and  analyzing  algorithms  with 
appropriate  performance ,  robustness  and  scalability  properties  for  various  task  allocation,  surveillance, 
and  information  gathering  applications. 

1  lie  focus  of  this  proposal  is  twofold.  The  first  set  of  deliverables  is  related  to  the  development  of 
a  general  modeling  framework  for  robotic  networks.  The  second  set  of  deliverables  is  related  to  the 
development  of  a  class  of  distributed  algorithms  for  target  assignments;  based  on  the  classic  auction 
algorithms  in  static  networks,  we  intend  to  design  efficient  algorithms  in  worst  case,  stochastic  and 
dynamic  environments.  Specific  deliverables  include: 

1  an  algorithmic  theory  of  robotic  networks;  we  aim  to  provide  a  formal  model  of  communication, 
control,  and  computation  and  establish  rigorous  performance  bounds  for  basic  robotic  tasks,  such 
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as  deployment  and  rendezvous.  We  aim  to  provide  a  full  suite  of  results  on:  time,  communication, 
space  and  energy  complexity  for  algorithms  that  tolerate  processor  and  communication  failures 
in  faee  of  wireless  and  physical  congestion. 

2.  efficient  algorithms  for  target  assignment  and  formation  control;  we  envision  the  design  of  efficient 
algorithms  to  divide  a  group  of  known  targets  among  the  robots  and,  simultaneously,  steer  each 
robot  to  its  target  set.  At  its  heart,  this  is  a  combinatorial  problem  to  be  solved  in  a  distributed 
receding-horizon  manner.  In  this  context  we  will  consider  various  possible  information  patterns 
available  to  the  agents,  stochastic  and  dynamic  scenarios,  and  sensor-based  tasks,  e.g.,  networks 
with  visibility,  electromagnetic  and/or  acoustic  sensors. 

From  a  technical  viewpoint,  the  key  challenge  lies  at  the  intersection  of  distributed  computation  com¬ 
binatorial  optimization,  computational  geometry,  and  control  theory. 

2  Technical  Accomplishments 

We  begin  with  a  schematic  description  of  the  technical  work  completed  as  fully  or  partly  supported  by 
this  award.  The  results  are  organized  in  four  main  thrusts: 

1.  dynamic  vehicle  routing  and  target  assignment, 

2.  distributed  deployment  and  partitioning, 

3.  theory  of  robotic  networks  and  distributed  optimization,  and 

4.  other  robotic  coordination  algorithms. 

The  journal  publications,  listed  in  Section  3,  are  organized  in  the  same  four  thrusts. 

2.1  Dynamic  vehicle  routing  and  target  assignment 

Supported  by  this  grant,  we  developed  novel  concepts  and  algorithms  for  dynamic  vehicle  routing 
(DVR),  that  is,  for  the  automatic  planning  of  optimal  multi-vehicle  routes  to  perform  tasks  that  are 
generated  over  time  by  an  exogenous  process.  We  considered  a  rich  variety  of  scenarios  relevant  for 
robotic  applications.  The  basic  DVR  problem  is  stated  as  follows:  demands  for  service  arrive  at 
random  locations  at  random  times  and  a  vehicle  travels  to  provide  oil-site  service  while  minimizing  the 
expected  wait  time  of  the  demands.  Throughout  the  course  of  this  grant,  we  have  treated  different  multi- 
vehicle  scenarios  based  on  different  models  for  demands  (e.g.,  demands  with  different  priority  levels  and 
impatient  demands),  vehicles  (e.g.,  motion  constraints,  communication  and  sensing  capabilities),  and 
tasks.  The  performance  criterion  used  in  these  scenarios  is  either  the  expect  ed  wait  time  of  t  he  demands 
or  the  fraction  of  demands  serviced  successfully.  In  each  specific  DVR  scenario,  we  adopted  a  rigorous 
technical  approach  that  relies  upon  methods  from  queueing  theory,  combinatorial  optimization  and 
stochastic  geometry.  First,  we  establish  fundamental  limits  on  the  achievable  performance,  including 
limits  on  stability  and  quality  of  service.  Second,  we  design  algorithms,  and  provide  provable  guarantees 
on  their  performance  with  respect  to  the  fundamental  limits. 

Specific  results  include  the  following.  Article  [,J2]  contains  a  comprehensive  t  heory  of  st  atic  assign¬ 
ment  problems  for  robotic  networks.  Article  [J3]  deals  with  the  dynamic  team  forming  problem,  in 
which  targets  require  simultaneous  servicing  by  teams  of  robots  with  distinct  capacities.  Article  [J4] 
proposes  cooperative  routing  policies  that  take  into  explicit  account  the  lionholonornic  constrains  of 
aerial  vehicles.  Article  [J5]  proposes  cooperative  routing  policies  that  efficiently  handle  distinct  priori¬ 
ties  in  the  targets  to  be  serviced.  Article  J6]  is  the  first  article  to  propose  policies  for  moving  targets 
the  proposed  policies  are  polynomial  time  and  come  with  performance  guarantees.  Finally,  article  [,J7] 
is  a  survey  article  that  neatly  organizes  all  results  in  a  unique  reference. 
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2.2  Distributed  deployment  and  partitioning 

Deployment,  partitioning  and  coverage  control  problems  have  been  a  strong  interest  since  our  highly 
cite  original  article  in  the  IEEE  Transactions  on  Robotics  and  Automation  in  2004.  During  this  period, 
we  have  made  a  number  of  important  advances.  First,  from  an  educational  viewpoint,  we  completed 
and  published  our  monograph  on  this  topic,  reference  [131] . 

Second,  in  references  [J9]  and  [J12],  we  have  proposed  novel  distributed  algorithms  that  require 
only  short-range,  unreliable  pairwise  “gossip”  communication  between  the  agents.  The  algorithms  has 
two  parts:  a  motion  protocol  to  ensure  the  robots  communicate  with  their  neighbors,  and  a  pairwise 
partitioning  rule  to  update  territory  when  two  robots  meet.  Our  theoretical  analysis,  based  on  a 
dynamical  system  on  partitions  of  the  graph’s  vertices,  shows  that  the  territory  partition  converges  to 
a  centro id al  Voronoi  partition  in  finite  time.  A  key  innovative  idea  is  describing  coverage  algorithms 
for  robot  deployment  and  environment  partitioning  as  dynamical  systems  on  a  space  of  partitions.  In 
other  words,  we  study  the  evolution  of  the  regions  assigned  to  each  agent  rather  than  the  evolution  of 
the  agents’  positions.  We  also  establish  scalability  properties  for  the  algorithm  and  describe  how  it  can 
be  implemented  on  robots  with  limited  computational  resources.  We  have  implemented  it  using  the 
Player/St  age  robot  control  system,  and  developed  hoth  large-scale  simulations  in  complex  environments 
as  well  as  hardware  experiments  in  our  lab. 

We  have  also  made  progress  in  a  number  of  related  directions.  In  article  [48],  we  propose  distributed 
and  adaptive  algorithms  for  equitable  partitioning.  Equitable  partitioning  is  related  to  load  balancing 
in  dynamic  vehicle  routing  and  in  other  robotic  spatial  tasks.  Article  [410]  proposes  robot  placement 
strategies  and  environment  partitioning  policies  for  the  purpose  of  intercepting  moving  targets.  Finally, 
article  [411]  proposes  distributed  deployment  algorithms  for  visibility  coverage  in  polygonal  environ¬ 
ments  with  holes;  the  algorithms  are  related  to  our  previous  work  on  the  distributed  art  gallery  problem 
and  are  the  first  to  obtain  rigorous  bounds  on  the  number  of  required  agents  and  complete  visibility 
guarantees. 

2.3  Theory  of  robotic  networks  and  distributed  optimization 

We  continued  our  work  on  a  general  theory  of  robotic  networks.  Beginning  with  two  joint,  articles  in 
the  IEEE  Transactions  on  Automatic  Control  (supported  by  a  previous  ONR.  grant),  we  presented  a 
more  comprehensive  theory  in  the  text  [Bl] .  We  also  addressed  various  quantization  problems  in  the 
two  references  [413]  and  [414]. 

Finally,  on  a  partly  related  directions,  we  have  recently  developed  a  novel  distributed  solver  for 
abstract  linear  programs.  Distributed  abstract  programs  are  a  novel  class  of  distributed  optimization 
problems  that  generalize  linear  programs,  support  vector  machine  training,  learning  problems,  and 
various  geometric  optimization  problems.  Journal  article  [415]  proposes  novel  ’’constraints  consensus 
algorithms’'  that  are  appropriate  for  networks  with  weak  time-dependent  connectivity  requirements 
and  tight  memory  constraints. 

2.4  Other  robotic  coordination  algorithms 

In  references  [JIG],  [417]  and  [418]  we  pursued  other  research  directions  In  reference  [416],  we  address 
discrete-time  pursuit-evasion  games  in  the  plane,  where  every  player  lias  identical  sensing  and  motion 
ranges;  we  propose  a  Sweep-Pursuit-Capture  pursuer  strategy  to  capture  the  evader  and  apply  it  to  two 
variants  of  the  game.  In  reference  [ J 17]  we  propose  algorithms  that  compute  polygon  approximations 
for  convex  contours;  this  geometric  optimization  problem  is  relevant  in  interpolation  theory,  data 
compression,  and  has  potential  applications  in  robotic  sensor  networks.  In  reference  [418]  we  study 
the  visibility-maintenance  problem  for  a  leader-follower  pair  of  aerial  vehicles  with  input  constraints, 
and  propose  an  original  solution  based  on  the  notion  of  controlled  invariance. 
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Scientific  Personnel 


•  Francesco  Bnllo,  PI 

•  Stephen  Smith,  supported  as  PhD  student  at  least  2  years,  now  postdoc  at  MIT,  Assistant 
Professor  at  University  of  Waterloo  beginning  March  2011 

•  Shaunak  D.  Bopardikar,  supported  as  PhD  student  at  least  1  year,  now  postdoc  at  UCSB 

•  Joseph  W.  Durham,  supported  as  PhD  student  at  least  2  years,  expected  graduation  April  2011 

•  Paolo  Frasca  and  Fabio  Morbidi.  visiting  PhD  students,  now  postdocs  at  University  of  Torino 
and  Northwestern  University,  respectively 

Collaboration  with  other  scientists,  not  supported  on  this  grant: 

•  Ruggero  Carli.  now  Assistant  Professor  at  University  of  Padova 

•  Marco  Pavone,  now  Research  Scientists  at  JPL 

•  Giuseppe  Notarstefano,  now  Assistant  Professor  at  University  of  Lecce 


5  Research  Awards  and  Honors 

The  following  awards  were  received  by  the  PI  and  his  group  during  the  award  period: 

•  Plenary  Speaker: 

3rd  IEEE  Multi-Conference  in  Systems  and  Control  (MSC),  Saint  Petersburg,  Russia,  Jul  2009 

•  SerniPlenary  or  Keynote  Speaker: 

2nd  IFAC  Workshop  on  Distributed  Estimation  and  Control  in  Networked  Systems,  Annecy, 
France,  Sep  2010 

Symposium  on  Recent  Trends  in  Networked  Systems  and  Cooperative  Control.  Stuttgart,  Ger¬ 
many,  Sep  2009 

5th  International  Conference  on  Applied  Mathematics  and  Computing,  Plovdiv,  Bulgaria, 
Aug  2008 

•  IEEE  Fellow,  Class  of  2010 

•  Article  selection  for  inclusion  in  S1GEST  section  of  SIAM  Review,  Mar  2009 

•  Outstanding  Paper  Award,  IEEE  Control  Systems  Magazine,  2008 

•  Best  Student  Paper  Award  Winner  (as  advisor):  ACC  2000,  ACC  2010 

•  Best  Student  Paper  Award  Finalist  (as  advisor):  CDC  2007 

•  Best  PhD  Thesis  Award,  CCDC,  UCSB  (as  advisor) 

•  Primo  Professor,  Kiosk  UCSB  Student  Handbook,  2008-2010 

•  Outstanding  Faculty  Member,  Mechanical  Engineering,  UCSB.  Spring  2008 

•  Invited  Lecturer,  Summer  School  of  Automatic  Control,  Grenoble,  France,  Sep  2010 

•  Invited  Lecturer,  Summer  School  on  Networked  Control  Systems,  Siena,  Italy,  Jill  2009 
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(2010):  UC  San  Diego  (1TA  Workshop),  University  of  New  Mexico,  Los  Alamos  National  Laboratory, 
Massachusetts  Institute  of  Technology,  ARL  Adelphi  Laboratory  Center,  California  Institute 
of  Technology,  University  of  Southern  California,  University  of  Illinois  at  Urbana-Champaign, 
Northwestern  University,  University  of  Illinois  at  Chicago,  University  of  Cagliari  (Italy), 
CNRS  Supelee  (France),  UC  Irvine 

(2009):  UC  San  Diego  (ITA  Workshop),  University  of  Liege  (Belgium),  University  of  Washington, 
Carnegie  Mellon  University,  Block  Island  Workshop  on  Swarming,  University  of  Lecce  (Italy), 
University  of  Stuttgart  (Germany,  NE{S|T}COC  Symposium),  ETH  Ziirich  (Switzerland) 
(2008):  UC  San  Diego  (ITA  Workshop),  University  of  Siena  (Italy),  University  of  Pisa  (Italy),  UC 
Los  Angeles,  Yale  University,  City  College  of  New  York,  University  of  Pennsylvania,  Mas¬ 
sachusetts  Institute  of  Technology,  Yale  University  (Frontiers  in  Distributed  Communication, 
Sensing  and  Control  Workshop),  Johns  Hopkins  University 
(2007):  University  of  Illinois,  Georgia  Tech  (RSS  Workshop  on  Robotic  Sensor  Networks),  Australian 
National  University  (Canberra,  ACT) 

G  Report  of  Patents  and  Inventions 

None. 
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